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(57) Abstract 



t 1 



A computer vision apparatus (10) and methods for automatically inspecting two-dimensional (2D) and three-dimensional (3D) 
criteria of objects (16) using a single camera (17) and laser sources (11, 12). A camera (17) views the object (16) under inspection which 
is illuminated by a first source of light (18) to highlight the region of interest This provides image data for two-dimensional analysis by 
a computer (19) coupled to the system. Subsequently, multiple laser sources (11, 12) mounted on a positioner provide the illumination for 
collecting images for three-dimensional analysis. A computer (19) with a monitor is connected to the camera (17) to perform the inspection 
and analysis and for operator supervision of the system. Specific implementations provided refer to embodiments for inspecting packaged 
semiconductor devices such as Ball-Grid Arrays packages (16b), Quad Flat Packages (16a), solder ball, lead defects, chip sized packages, 
Flip-Chip Bump and I.C. Die inspection. 



n <WO 990Q661A1_L> 



FOR THE PURPOSES OF INFORMATION ONLY 
Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


sz 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


UZ 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


ZW 


Zimbabwe 


CI 


C6te d'lvoire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


FT 


Portugal 






CU 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






CZ 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


Li 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







SDOCID: <WO_9900661A1 t > 



WO 99/00661 



PCTAJS98/13303 



-1- 

Method and Apparatus for Inspecting a Workpiece 
Background of the Invention 

5 

1 . Field of the Invention 

The invention relates generally to the use of automatic inspection of objects to 
perform three dimensional and two dimensional criteria analysis, and more specifically 
to the use of two and three dimensional criteria analysis to perform lead inspection, 
10 package mark and package inspection of integrated circuit devices including 

semiconductor circuits. The techniques and methods of the invention can also be applied 
to the inspection of solder balls of Ball Grid Array (BGA) integrated circuit packages 
and to the inspection of Chip Sized Packages (CSP) integrated circuit packages using 
computer vision. 

15 

2. Description of Related Art 

This invention relates to combining two dimensional and three dimensional 
automated imaging inspection in a system. In the prior art, there are several approaches 
and some commercial applications which perform two dimensional (2D) and three 

20 dimensional (3D) image inspections individually. There are known systems which 
perform lead inspection (looking for and sometimes correcting bent leads), package 
mark inspection (checking the vendors mark and device number and type designators 
which are typically painted or printed on the plastic body of the package) and package 
defect inspection (holes, cracks or other irregularities in the surface of the plastic 

25 packaged device) of semiconductor packages. There also several known approaches 
relating to semiconductor package lead inspection of quad flat packages (hereinafter 
referred to as QFPs) and ball grid array packages (BGAs). 

The following U.S. Patents are referred to herein as references typifying the approaches 
of the prior art. 

30 
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2d 


Mark Inspection 


4,589,141 


5/1986 


Christian et al 


3d 


Lead Inspection 
* 


5,414,458 


5/1995 


Harris et al 




i nicKncss inspection 


0,0/ i, /zo 


O/ 1972 


Kerr et al. 


3d 


Information 


4,259,589 


3/1981 


DiMatteo et al. 


3d 


Sensors 


4,891,772 


1/1990 


Case et al. 


3d 


Laser Probe 


4,733,969 


3/1988 


Case et al. 


3d 


Imaging 


5,024,529 


6/1991 


Svetkoff et al. 


3d 


Triangulation 


4,774,403 


9/1988 


Arts et al. 



Several commercially available systems for inspecting integrated circuit packages 
are available. View Engineering provides systems where the image of a single point 
laser that oscillates at a high frequency, visible as a line on the object, is input into a 
5 camera. The laser points straight down from above the device undergoing inspection 
with the camera looking at an angle. The camera and laser source form the laser head. 
This laser head has to move over the entire device to generate a complete 3d image of 
the object. There are several problems with this approach . An X-Y positioner with a 
travel of greater than about 6" x 12" is required to move the laser head over a tray of 

10 devices. In addition, the X-Y positioner has to be attached to large granite blocks to 

dampen vibrations which could distort the results A separate camera performs a second 
inspection for package mark and package defects at a separate location on the machine. 

In a system available from RVSI, Incorporated, a single point laser, with a one or 
more sensors, is used to triangulate to determine 3D inspection criteria. The laser 

15 sensors and the laser source form the laser head. This laser head is then moved over the 
device several times to generate 3D information of the points under the laser. The laser 
points straight down with the sensors at an angle to the laser. 

Again, with the RVSI approach, an X-Y head positioner with a travel of greater 
than about 6" x 12" is required to move the laser head over a tray of devices. In 

20 addition, the X-Y positioner again has to be attached to large granite blocks to dampen 
vibrations. Package mark inspection and package defect inspection is performed by a 
separate camera placed at a separate location on the machine. For quad flat packages 
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(QFPs), the package has to be placed so as have to be "live bug" ( package normal 
orientation). However, for ball grid array packages (BGAs), these devices have to be 
placed "dead-bug" (upside down) for the inspection. 

In systems available from ICOS, Incorporated, four light sources are used to 
5 form a shadow of the device leads. A single camera looks upwards to analyze the 

displacement of the shadow to determine 3D displacement of leads and so perform lead 
inspection. No laser light source is used. Again, there are several problems in this 
approach. As with the other systems, a separate camera inspects for package mark and 
package defects. The system cannot inspect BGA packages. 

10 In systems currently available from Texas Instruments Incorporated, a single 

camera is used to look at the silhouette of the leads. The device is rotated four times to 
generate 4 images which is then analyzed to determine 3d displacement of leads. No 
laser light source is used. With this system, QFPs have to be positioned upside down 
and the system cannot inspect BGAs. Also, as with the other systems, a separate camera 

15 inspects for package mark and package defects. 

Further with respect to the existing systems, most systems using trianguiation to 
perform 3D criteria inspection have laser light sources going straight down at the object 
with the camera positioned at an angle of about 45 degrees. This implies modifying the 
plane of the CCD imager of the camera in order to achieve the Schiempflug condition of 

20 the optical axis of the lens, with the plane of the CCD imager and the plane of the laser 
source intersecting at a point. It is important to achieve this condition to have optimal 
focus of the object being looked at. This aspect of the prior art systems requires 
modifying a camera based on a CCD system. 

Accordingly, a need thus exists for an apparatus and method for performing 

25 computer vision analysis of objects using a single camera solution to perform two- 
dimensional and three dimensional criteria analysis. 

Summary of the Invention 

The inspection system of the invention described herein uses fiber optics ring 
30 light or LED based ring-light as a light source to illuminate the 2D scenes, depending on 
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the type of inspection required. There is a plurality of lasers mounted to motorized linear 
positioners that provides structured light based illumination for performing the 3D 
criteria measurements. In performing inspections of semiconductor devices and micro- 
electronics, the devices can be completely inspected using 4 lasers. Triangular -shaped 

5 objects could be inspected using three laser sources while larger polygonal shapes could 
deploy more lasers to provide appropriate coverage. 

In the system of the invention, the 2D lighting is switched on first to illuminate 
the object. The single camera captures the image and presents it to a computer system 
for image analysis. On analysis of the scene, the system determines the absence or 

10 presence of defects that fall into the 2D category, and location of portions of the object 
that need 3D criteria analysis. 

Once the X-Y location of the area needing 3D inspection is determined, the 
plurality of lasers are positioned over the area and then moved at a constant velocity 
while a plurality of images are collected by the camera. Analysis of the location of the 

15 laser stripe, given the location information provided by the encoder for the linear 

positioner of the laser, provides information as to the displacement, in 3 dimensions, for 
that area of the object. 

The unique features of this invention are that it provides combined 2D inspection 
criteria, such as package mark inspection and package defect inspection, along with 3D 

20 inspection such as lead coplanarity, in a single camera system. This is in contrast to the 
existing systems which use either multiple cameras or laser triangulation to inspect for 
3D inspection criteria and subsequently perform the 2D criteria at a separate camera. 

In one embodiment of the invention, the camera is provided looking straight 
down or up at the object, so the object does not appear tilted and hence there is no need 

25 for the achieving focus through the Schiempflug condition. Hence use of the invention 
described herein results in a reduction in assembly costs in not having to modify 
cameras. 

In contrast to the prior art systems, no granite or large X-Y positioner is required 
to move the laser head over the leads. While the laser head is stationary, positioned over 
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the device, laser sources mounted onto small slides scan the leads. This approach 

advantageously does not require large mass for damping. 

The system of the invention also provides the flexibility of being able to inspect 

the package in a variety of orientations. This feature of the system allows the device 
5 inspection head to adapt to the system on which the device is to be inspected rather than 

modifying the system to adapt to the inspection head. For example, QFP packages can 

be inspected live bug or dead-bug (normal or upside down orientation, respectively) - 

with the camera pointing down or up towards the device. BGAs can be inspected live 

bug (Camera pointing up) or dead-bug (camera pointing down) . Package mark and 
10 package defects can be inspected on the same station when inspecting QFPs in the live 

bug orientation. Substrate defects can be inspected on the BGA packages at the same 

station as other package types. 

These and other objects, advantages and features of this invention will be 

apparent from the following description taken with reference to the accompanying 
15 drawing, wherein is shown a preferred embodiment of the invention. 

Brief Description of the Drawing 

FIGURE 1 is a pictorial representation of a first embodiment of the apparatus of 
the invention; 

20 FIGURE 2 is a view of the optical path used for 2D inspection in a preferred 

method of the invention of Figure 1 ; 

FIGURE 3 is a view of the optical path used for 3D inspection in a preferred 
method of the invention of Figure 1; 

FIGURE 4 is a view of a QFP packaged semiconductor device under 2D 
25 inspection using the methods of the invention; 

FIGURE 5a is a view of an image of a QFP packaged semiconductor device 
under 3D inspection; 

FIGURE 5b is the image of the QFP of Figure 5a as captured by the camera 
according to the invention; 
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FIGURE 6a is a view of an image of a BGA packaged semiconductor device 
under 3D inspection; 

FIGURE 6b is the image of the BGA of Figure 5a as captured by the camera 
according to the invention; 

5 FIGURE 7 is a flow diagram representation of a method according to the present 

invention; 

FIGURE 8 is a flow diagram representation of a method according to the present 
invention for 2D inspection of a QFP packaged semiconductor device; 

FIGURE 9 is a flow diagram representation of a method according to the present 
10 invention for 2D inspection of a BGA packaged semiconductor device; 

FIGURE 10 is a flow diagram representation of a method according to the 
present invention for 3D inspection of a QFP packaged semiconductor device; and 

FIGURE 1 1 is a flow diagram representation of a method according to the 
present invention for 3D inspection of a BGA packaged semiconductor device. 
15 Corresponding numerals and symbols in the different figures refer to 

corresponding parts unless otherwise indicated in the specification and the figures. 

Description of the Preferred Embodiment 

Referring now to the drawing, and in particular to Figure 1, a system according 

20 to the present invention is referred to generally by reference numeral 10 and a workpiece 
to be inspected is referred to by reference numeral 16. A laser source 11 is mounted to 
a linear positioner 13. Three (alternatively, more could be used) other lasers are 
mounted to other linear positioners placed 90 degrees apart. A laser source 12 mounted 
to a linear positioner 14 is another example of laser mounted to a positioner. This 

25 arrangement produces the source of light for the 3D image which is imaged through lens 
15 and received by camera 17. Some light source such as a ring-light 18 may be used to 
produce a 2D image. This ring-light could change to other light sources depending on 
the nature of workpiece 16 being inspected. The image from the camera is input into a 
personal computer (PC) class computer, 19, via cable 20. Other computers could be 

30 used, such as workstations, mainframes, or smaller computers such as industrial type 
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microcontrollers or programmable personal digital assistants or notebooks, laptops, etc. 
The laser sources and the ring-light are switched on and off when needed by the PC via 
cables 21 and 22. 

Referring now to Figure 2, ring-light 18 provides light 32 and 33 onto workpiece 
5 to be inspected 16 from all sides of camera 17 for the 2D inspection. The reflections 34 
and 35 are imaged through lens 15 and received into camera 17, typically a CCD 
imaging camera. The particular type of light can vary depending on the criteria to be 
inspected. Some types of criteria are highlighted only by ring-light mounted high, while 
others can only be illuminated by strobed light mounted low. The image produced by 

10 the 2D lighting, of a typical QFP device is shown in Figure 4. 

Referring to Figure 3, a view of the optical path for 3D inspection is shown. In 
this embodiment, four sources of flat-beam of laser-light are mounted on four linear 
positioners at right angles to each other. In an alternative arrangement, the four laser 
sources could sweep to cover the same range covered by the flat beams. Two of the 

15 laser sources, 11 and 12, are mounted to linear positioners 13 and 14 respectively. The 
remaining two laser sources and linear positioners would be perpendicular to the plane 
of the figure and are not shown. Two perpendicular Linear positioners 13 and 14 can 
move toward camera 17 in direction 39 for linear positioner 13 and direction 40 for 
linear positioner 14; they can also move away from the camera in the opposite 

20 directions. A laser beam 37 strikes the workpiece to be inspected 16. The reflection has 
some secondary reflection 38 which goes straight up through lens 15 into camera 17. 
The triangulation effect is described below with the image of a QFP as 
seen by the camera as depicted below in Figure 5. 

Figure 4 shows a top view of a QFP packaged integrated circuit device under 2D 

25 lighting designed to highlight voids 41 and package marking 42. This lighting is 
provided such that after the camera captures the image, the computer system and 
software can analyze the image data to determine if voids exist in the plastic package and 
that the quality of marking 42 is acceptable under pre-set criteria. Typically, the 
software application used in the computer system identifies the marking 42 and compares 

30 it to a predefined set of acceptable templates or other measures, and if the package 
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marking falls within a certain acceptable threshold or range, the marking is acceptable. 
Other defect classification approaches could be used. If the marking is not considered 
acceptable, the package marking is classified as having a certain defect, and either an 
indication is immediately made to the operator, or the defect is logged in a form that is 

5 available for later use in identifying the defective units. In addition, the camera in 

conjunction with the computer and software makes it possible to detect and note the X 
and Y location of the leads, 43. The system uses the X and Y location information to 
determine the integrity of lead dimensions and identify defects such as bent-lead and lead 
pitch defects. In addition, the X and Y location of the leads is used to control and strobe 

10 the laser light at the right spot for the camera to determine 3D information in subsequent 
steps. 

Referring to Figure 5, a QFP 16a is under 3D lighting designed to highlight 
dimensional defects such as coplanarity of leads or other normally coplanar surfaces. 
The laser light reflects back from the leads as shown in 51 . A shift 52 in the laser line 

15 because the lead being illuminated has lifted by some amount. The camera only detects 
the view as shown by laser light 53 falling on the leads with the defect being highlighted 
by 54. The leads could have been anywhere in the image, hence the initial picture 
captured by 2D is analyzed by the computer and the application software to determine 
the X-Y location of the leads. The laser sources are then moved across the device and 

20 fired at approximately the position where the laser would fall on the leads. Computer 
and software analysis made on the location of the laser line with respect to the position 
of the scanner provides information as to the 3d displacement of that lead. The principal 
behind the computer analysis is based on structured lighting, i.e: if the laser source is at 
a certain location, and the light is detected by the camera and software at a certain 

25 location, then the point at which the laser light fell on the object being examined is at 

some determinable location in 3D. If the object was either higher or lower in 3D,(z-axis 
offset from the X-Y plane) then the laser light would be detected at different locations by 
the camera. This information can be used to identify defects, or possibly to control lead 
conditioning equipment which may correct the defect by straightening or otherwise 

30 operating on the leads identified as not acceptable by the 3D criteria analysis. 
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Referring to Figure 6, a BGA 16b is under 3D lighting designed to highlight 
dimensional defects such as height, width or location of balls. The laser light reflects 
back from the balls as shown in 56. A shift would be caused in the laser line if a ball 
being illuminated was larger or out of location by some amount. The camera only detects 

5 the view as shown by laser light 58 reflecting back from the balls. The balls could have 
been anywhere in the image, hence the initial picture captured by 2D is analyzed by the 
computer and the application software to determine the X-Y location of the balls. The 
laser sources are then moved across the device and fired at approximately the position 
where the laser would fall on the balls. The best reflection is actually before the laser 

10 reaches the center of the balls. Computer and software analysis made on the location of 
the laser line with respect to the position of the scanner provides information as to the 3d 
displacement of each ball. 

Referring now to Figure 7, a method for examining a workpiece according to the 
present invention is referred to generally by reference numeral 76. The first step 78 is 

15 performed by illuminating the object and using the CCD camera to capture and store an 
image. 

The second step 80 involves applying software to the captured image data to 
determine 2D criteria, such as package voids, package marking, and lead locations. This 
step can complete the 2D analysis and sets up the data required for the 3D analysis. 
20 Where the 2D analysis performed by the software indicates a need for further 3D 
analysis, the third step is performed at those locations. 

The third step 82 involves capturing additional image data using the camera and 
the laser sources at the locations where a 3D criteria inspection is required. 

Finally, the data collected in the third step is used to perform the 3D criteria 
25 inspection 84. Software techniques are used to determine where the laser reflections are 
expected to occur from the laser sources fired in the third step. The actual reflection data 
is compared to the expected data to determine if a z-axis offset (such as bent lead defect 
or other non-planar defect) has occurred, and if so, an estimate of the offset in the z axis 
direction can be determined. This information can be reported immediately, stored as a 
30 log with respect to the particular device, or used to drive lead conditioning equipment to 
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attempt to correct the defect, or otherwise used by the system. Also, if the estimated z- 
axis offset is compared to a predetermined threshold or range, the software can indicate 
whether the offset is within user defined acceptable limits or whether it can be corrected, 
or not. 

5 Referring now to Figures 8 and 10, a method 100 for 2D inspection of BGA 

packaged devices or CSP packages is similar to the QFP packaged device inspection 
method 86. First, locate 88 two edges of the rows of leads which are at right angles to 
each other for the QFP or locate 102 two edge rows of balls at right angles to each 
other, in the embodiments as illustrated referred to as a top edge and a left edge and 

10 calculate the center of the workpiece. Next, locate 90 the outside edge of a few leads on 
each side of a row for the QFP or locate 104 the outside edge of a few balls of an 
outside row for a BGA, in the embodiments illustrated a few leads or a few balls both to 
the left and right of the top edge to determine the orientation of the workpiece. A step 
92 for QFP and 106 for BGA of rotating the workpiece as needed is performed prior to 

15 the two dimensional criteria analysis and then the subsequent three dimensional criteria 
analysis for each ball. Calculate 94 and 108 the expected location of each lead or ball 
respectively, the actually locate each lead or ball. At this point, any displacement of 
leads of balls in an x-y, two dimensional, fashion can be calculated 98 and 112 
respectively. Again, software in the two dimensional criteria analysis can perform 

20 certain inspections and collect location data which is used to drive the three dimensional 
criteria analysis. 

Referring now to Figure 10 and Figure 1 1 , after the two dimensional image is 
collected, the laser head is moved 1 16 or 130 from the outside of the device towards the 
inside and at appropriate locations, the laser sources are fired and images collected 118 

25 or 132 by the camera. For BGA packages, the number and location of rows must first 
be found 126 and the center for each row calculated 128. The positions of the 
reflections are determined 120 or 134 and the coplanarity is calculated 122 or 136 by 
software to identify 3D criteria and to locate defects in lead positions or length or ball 
positions or height, and other defects that are of particular interest in lead semiconductor 

30 packages or solder ball bearing semiconductor packages. This step is continued until all 
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the rows of solder balls are inspected on each side of the device, or in the case of an 

array style BGA package, all the way across the packaged device. 

The methods and apparatus described herein can also be extended to the visual 
inspection of many other devices and in many industries. For example, inspection of 
5 balls used in "flip chip* 1 packages or inspection of unpackaged integrated circuit die is 
contemplated. Automated inspection of completed wire bonds for wire bond loop height 
and other criteria is also contemplated herein. Inspection of sub assemblies such as those 
used for disk drives, keyboards, CD-Roms and other such devices are also 
contemplated. Practitioners skilled in the art will recognize the utility and advantages of 
10 this invention in many other applications, all of which are contemplated as part of the 
invention described herein and as claimed in the appended claims. 

While this invention has been described with reference to illustrative 
embodiments, this description is not intended to be construed in a limiting sense. 
Various modifications and combinations of the illustrative embodiments, as well as other 
15 embodiments of the invention, will be apparent to persons skilled in the art upon 

reference to the description. It is therefore intended that the appended claims encompass 
any such modifications or embodiments. 

From the foregoing it will be seen that this invention is well adapted to attain all 
of the ends and objectives hereinabove set forth, together with other advantages which 
20 are inherent to the apparatus. 

It will be understood that certain features and subcombinations are of utility and 
may be employed without reference to other features and subcombinations. This is 
contemplated by and is within the scope of the claims. 

As many possible embodiments may be made of the invention without departing 
25 from the scope thereof, it is to be understood that all matter herein set forth or shown in 
the figures of the accompanying drawings is to be interpreted as illustrative and not in a 
limiting sense. 
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The Claims 



1. A system for the inspection of a workpiece, the system comprising in 
combination: 

5 a camera held in a position facing the workpiece; 

at least one linear positioner which can move toward the camera and away from 
the camera; and 

at least one laser mounted on the at least one linear positioner at an angle to the 
direction faced by the camera, wherein the linear positioner can move to a 
10 position wherein the laser is aimed at the workpiece. 

2. A system according to Claim 1 wherein the at least one linear positioner 
comprises four linear positioners placed on four different sides of the camera, 
and the at least one laser comprises four lasers, one laser mounted on each of the 

15 four linear positioners. 



3. A system according to Claim 2 further comprising a computer controlling the 
camera, the linear positioners, and the lasers. 

20 4. A system according to Claim 3 wherein the workpiece has a substantially flat 

rectangular top surface and a substantially flat rectangular bottom surface and four edges 
connecting the two substantially flat surfaces, with a row of electrical leads extending 
from each of the four edges, and wherein the camera faces one of the substantially flat 
rectangular surfaces, and the four linear positioners approach the camera from directions 

25 which are perpendicular to the four edges of the workpiece and can move to positions 
wherein the lasers are aimed at the rows of electrical leads. 



5. A system according to Claim 3 wherein the workpiece has a substantially flat 
rectangular top surface and a substantially flat rectangular bottom surface and four edges 
30 connecting the two substantially flat surfaces, with a row of electrical leads extending 
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frorn each of the four edges, and wherein the camera faces one of the substantially flat 
rectangular surfaces, and the four linear positioners approach the camera from directions 
which are perpendicular to the four edges of the workpiece and can move to positions 
wherein the lasers are aimed at the rows of electrical leads. 

5 

6. A system according to Claim 4 wherein each laser projects a flat beam directly 
across a row of electrical leads. 

7. A system according to Claim 4 wherein each laser sweeps a beam directly across 
10 a row of electrical leads. 

8. A system according to Claim 3 wherein the workpiece has at least one 
substantially flat surface and a ball grid array on the at least one substantially flat 
surface, and wherein the camera faces the at least one substantially flat surface, and the 

15 four linear positioners approach the camera from directions which are perpendicular to 
the ball grid array and can move to positions wherein the lasers are aimed at the rows 
and columns of the ball grid array. 

9. A system according to Claim 8 wherein each laser projects a flat beam directly 
20 across a row or column of the ball grid array. 

10. A system according to Claim 8 wherein each laser sweeps a beam directly across 
a row or column of the ball grid array. 

25 11. A system according to Claim 1 further comprising a computer operably 

connected to and controlling the camera, the at least one linear positioner, and the at 
least one laser. 

12. A system according to Claim 11 wherein the workpiece has a substantially flat 
30 surface and a substantially linear edge with a row of electrical leads extending from the 
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edge, and wherein the camera faces the substantially flat surface, and the at least one 
linear positioner approaches the camera from a direction which is perpendicular to the 
edge of the workpiece and can move to a position wherein the at least one laser is aimed 
at the row of electrical leads. 

5 

13. A system according to Claim 12 wherein the at least one laser projects a flat 
beam directly across the row of electrical leads. 

14. A system according to Claim 12 wherein the at least one laser sweeps a beam 
10 directly across the row of electrical leads. 

15. A system according to Claim 1 1 wherein the workpiece has at least one 
substantially flat surface and a ball grid array on the at least one substantially flat 
surface, and wherein the camera faces the at least one substantially flat surface, and the 

15 at least one linear positioner approaches the camera from a direction which is 

perpendicular to the rows or columns of the ball grid array and can move to positions 
wherein the at least one laser is aimed at the rows or the columns of the array. 

16. A system according to Claim 15 wherein the at least one laser projects a flat 
20 beam directly across a row or column of the ball grid array. 

17. A system according to Claim 15 wherein the at least one laser sweeps a beam 
directly across a row or column of the ball grid array. 

25 18. A system for the inspection of a workpiece, the system comprising in 
combination: 

a camera held in a position facing the workpiece; 

a ring light positioned to shine on the workpiece from all sides of the camera; 
at least one linear positioner which can move toward the camera and away from 
30 the camera; and 
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at least one laser mounted on the at least one linear positioner at an angle to the 
direction faced by the camera, wherein the linear positioner can move to a 
position wherein the laser is aimed at the workpiece. 

5 19. A system according to Claim 18 wherein the at least one linear positioner 

comprises four linear positioners placed on four different sides of the camera, and the at 
least one laser comprises four lasers, one laser mounted on each of the four linear 
positioners. 

10 20. A system according to Claim 19 further comprising a computer controlling the 
camera, the ring light, the linear positioners, and the lasers. 

21. A system according to Claim 20 wherein the workpiece has a substantially flat 
rectangular top surface and a substantially flat rectangular bottom surface and four edges 

0 

15 connecting the two substantially flat surfaces, with a row of electrical leads extending 
from each of the four edges, and wherein the camera faces one of the substantially flat 
rectangular surfaces, and the four linear positioners approach the camera from directions 
which are perpendicular to the four edges of the workpiece and can move to positions 
wherein the lasers are aimed at the rows of electrical leads. 

20 

22. A system according to Claim 20 wherein the workpiece has a substantially flat 
rectangular top surface and a substantially flat rectangular bottom surface and four edges 
connecting the two substantially flat surfaces, with a row of electrical leads extending 
from each of the four edges, and wherein the camera faces one of the substantially flat 

25 rectangular surfaces, and the four linear positioners approach the camera from directions 
which are perpendicular to the four edges of the workpiece and can move to positions 
wherein the lasers are aimed at the rows of electrical leads. 

23. A system according to Claim 21 wherein each laser projects a flat beam directly 
30 across a row of electrical leads. 
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24. A system according to Claim 21 wherein each laser sweeps a beam directly 
across a row of electrical leads. 

5 25 . A system according to Claim 20 wherein the workpiece has at least one 
substantially flat surface and a ball grid array on the at least one substantially flat 
surface, and wherein the camera faces the at least one substantially flat surface, and the 
four linear positioners approach the camera from directions which are perpendicular to 
the ball grid array and can move to positions wherein the lasers are aimed at the rows 

10 and columns of the ball grid array. 

26. A system according to Claim 25 wherein each laser projects a flat beam directly 
across a row or column of the ball grid array. 

15 27. A system according to Claim 25 wherein each laser sweeps a beam directly 
across a row or column of the ball grid array. 

28. A system according to Claim 18 further comprising a computer operably 
connected to and controlling the camera, the ring light, the at least one linear positioner, 

20 and the at least one laser. 

29. A system according to Claim 28 wherein the workpiece has a substantially flat 
surface and a substantially linear edge with a row of electrical leads extending from the 
edge, and wherein the camera faces the substantially flat surface, and the at least one 

25 linear positioner approaches the camera from a direction which is perpendicular to the 
edge of the workpiece and can move to a position wherein the at least one laser is aimed 
at the row of electrical leads. 

30. A system according to Claim 29 wherein the at least one laser projects a flat 
30 beam directly across the row of electrical leads. 



3DOCID: <WO 9900661 A 1 I > 



WO 99/00661 



PCT/US98/13303 



10 



-17- 

31 . A system according to Claim 29 wherein the at least one laser sweeps a beam 
directly across the row of electrical leads. 

32. A system according to Claim 28 wherein the workpiece has at least one 
substantially flat surface and a ball grid array on the at least one substantially flat 
surface, and wherein the camera faces the at least one substantially flat surface, and the 
at least one linear positioner approaches the camera from a direction which is 
perpendicular to the rows or columns of the ball grid array and can move to positions 
wherein the at least one laser is aimed at the rows or the columns of the array. 

33. A system according to Claim 32 wherein the at least one laser projects a flat 
beam directly across a row or column of the ball grid array. 

15 34. A system according to Claim 32 wherein the at least one laser sweeps a beam 
directly across a row or column of the ball grid array. 

35. A method for inspecting a workpiece, comprising in combination the steps of: 
capturing an image of the workpiece using 2-D lighting; 

20 analyzing the image for 2-D criteria; 

determining the location of the workpiece for 3-D analysis; 
linearly moving the laser scanner to location; 

firing laser light at the workpiece and capturing an image of the laser light on the 
workpiece; and 

25 locating the laser light reflection and determining the location of the edge of the 

workpiece. 

36. A method for inspecting a workpiece having a substantially flat rectangular 
surface and at least one edge having a row of electrical leads extending from the at least 

30 one edge, the method comprising in combination the steps of: 
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shining 2-D light onto the workpiece; 
locating the tips of the leads in the row of electrical leads; 
capturing an image of the workpiece using the 2-D lighting; 
rotating the workpiece if the row of electrical leads is not substantially 
5 perpendicular to the direction of travel of a laser scanner; 

locating the tips of the leads in the row of electrical leads; 
linearly moving the laser scanner closer to workpiece; 

firing laser light at the workpiece from several positions, capturing an image of 
the laser light on the workpiece from each of the several positions; and 
10 for each lead in the row of electrical leads, analyzing each image of laser light 

reflection to generate 3-D information on the lead. 

37. A method for inspecting a workpiece having a substantially flat rectangular 
surface and a ball grid array on the substantially flat surface, the method comprising in 
15 combination the steps of: 

shining 2-D light onto the workpiece; 

locating the centers of the balls in a row or column of the ball grid array; 
capturing an image of the workpiece using the 2-D lighting; 
rotating the workpiece if a row or column of the ball grid array is not 
20 substantially perpendicular to the direction of travel of a laser scanner; 

locating the centers of the balls of the ball grid array; 
linearly moving the laser scanner closer to workpiece; 

firing laser light at the workpiece from several positions, capturing an image of 
the laser light on the workpiece from each of the several positions; and 
25 for each ball in a row or column of the ball grid array, analyzing each image of 

laser light reflection to generate 3-D information on the ball. 
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BGA 2D Inspection process 
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QFP 3D Inspection process 
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BGA 3D Inspection process 
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